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^ (57) Abstract: A nuithod and system ( ! 00) for using reference patches ( 108) to enhance electronic film processing of a scene image 
^ (104) contained on a first area of a film (112) include creating a reference patch (108) on a scconde area of the film (112); coating 
^ the film (112) with a developing solution to form a scene image ( 104) and a pau:h image (108); scanning the film (112) coated with 

the developing solution to generate signals conx^ponding to digital representations of the scene \xmgc (104) and the patch image 
O (108); calculating image processing parameters from the signals associated with the patch image (108); and processing the digital 

representations of the scene image (104) using the image processing parameters calculated from the patch image (108) lo produce 

color values which more accurately reflect the original scene and which are pleasing to the eye. 
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METHOD AND SYSTEM FOR USING CALIBRATION 
PATCHES IN ELECTRONIC FILM PROCESSING 



5 



TECHNICAL FIELD 



This invention relates generally to electronic film processing, and more particularly to 
a method and system for using calibration patches in electronic film processing. 



10 sensing layers. Each layer contains a light sensitive material, typically silver halide, that is 
spectrally sensitive to a specific portion of the visible light spectrum. In general, the top layer 
responds primarily to light of short wavelength (blue light), the middle layer responds 
primarily to light of medium wavelength (green light) and the bottom layer responds to light 
of long wavelength (red light). When film with these types of spectral sensitivities is exposed 

15 to visible light, each spot on the film records the intensity of blue, green and red light incident 
on that location of the film. This film record of incident light referred to as the latent image. 

In conventional color photographic development, systems, the exposed film is 
chemically processed to produce color dyes in the three layers with color densities directly 
proportional to the blue, green and red light intensities recorded as the latent image. 

20 Conventional chemical film processing involves the application of a number of processing 
solutions to the film to produce the color dyes. A developer solution is first applied to the 
exposed film. In a chemical reaction, the developer solution interacts with the silver halide 
and couplers in the film to produce elemental silver particles and a respective color dye. The 
development process is halted at the proper exposure by rinsing the developer solution off the 

25 film or^-stop solution to the film. A fixing solution is then applied to the film to convert the 
unexposed silver halide to elemental silver. A bleaching solution is then applied to the film 
to rinse away the elemental silver and leave the color dyes in each layer. Additional 
processing solutions can be applied to the film as required to preserve the film. The film is 
then dried and forms a conventional film negative. Through a conventional printing process, 

30 the film negative can be used to produce positive prints of the film negative. The film 
negative can also be electronically scanned to produce a digital image. 



BACKGROUND OF THE INVENTION 



Conventional color phot( 



lographic film generally contains tliree superimposed color 
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Image enhancement has been the subject of a large body of film processing 
technology. In particular, color correction is. a specific area of image enhancement that is 
particularly problematic. One difficulty with color correction is tr>'ing to correct colors that 
are incorrect without changing the true colors of the pictured scene. 

5 

SUMMARY OF THE INVENTION 

Briefly summarized, the present invention provides a method for using a calibration 
patch to electronically process exposed film. In one application, the film is exposed to a 
calibration light source thai creates a reference patch. Developer solution is then applied to 

10 the film. The film is then electronically scanned without removing the developer solution to 
produce an electronic image and an electronic reference image. The electronic reference 
image is then used to calculate processing parameters for the electronic image. In a panicular 
application, the electronic scanning process comprises electronically scanning the silver metal 
particles in the film. In another application, the electronic scanning process comprises 

15 electronically scanning the dyes in the film. In yet another application, the electronic 
scanning process comprises a combination of the above. 

In another application of the present invention, a method for using a calibration patch 
in a electronic film processing system is provided. In this application, an unexposed area of 
the film is exposed to a calibration signal to create a reference patch. The film is then 

20 developed to fonm scene images composed of silver metal particles. Signals corresponding to 
digital representations of scans of the scene image and the reference patch are generated. 
Image processing parameters fi-om the signals associated with the reference patch are 
calculated and used in processing the signals of the digital representations corresponding to 
the scene'image. The image processing parameters then produce initial color values which 

25 more^ccurately reflect the original scene and which are pleasing to the eye. 

The invention also provides an improved scanning device used to process a developed 
scene image on a film according to the present invention. The scanning device comprises a 
number of optic sensors, an electromagnetic energy source and computer processor. The 
optic sensors generate digital representations of the scene image and a reference patch image. 

30 The computer processor uses the digital representations to calculate image processing 

2 

BNSOOCIO: <WO Otl3t74AI J.> 



wboi/ni74 



PCT/US0bm^81 



parameters based on the reference patch to produce improved color values for the digital 
representations of the scene image. 

The various features and characteristics of the present invention will become more 
apparent when taken in conjunction with the drawings and the following description wherein. 
5 like referenced numerals represent like parts. 

BRIEF DESCRIPTION QF THE DRAWINGS 

FIG. I is a perspective view of a scanning device in accordance with the present 
invention; 

10 FIG. 2 is an illustration of a duplex film processing system in accordance with the 

present invention; and 

FIG. 3 is a plan view of film containing scene images and reference patches according 
to the present invention. 

15 DETAILED DESCRIPTION 

The method of the present invention involves exposing undeveloped film to a 
calibration light source to produce a reference patch. A developer solution is applied to the 
film to develop the film. The film is electronically scanned without removing the developer 
solution. In one embodiment, as described herein, the film is electronically scanned using a 

20 duplex scanning method whereby the elemental silver in the film is scanned. Duplex 
scanning generally utilizes two electromagnetic radiation sources, with one positioned in 
ft-ont and one in back of the film. The radiation from these sources is attenuated by the 
amount of silver metal particles at each spot on the film. The attenuated radiation is detected 
and convened to digital signals using appropriate optical and electronic systems. Based on 

25 the amount of detected radiation, one embodiment of the present invention produces four 
values, referred to as front, back, front-through and back-through data, for each pixel on the 
film. These signals are directly related to the silver metal particles that form the scene image. 

An improved digital film scanning apparatus 100, which includes a calibration 
exposure device 107 is shown in Fig. 1. The digital film scanning apparatus 100 may in turn 
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: b. pan ofa la,g„ oprtca, el«,romc sys^m. The scanning appa^us 100 op=,a.es by &' 

c„nv«,ns eleclromagncic ,adia.ion ftom an imate ,o an .l=c.™ic (digital) represaniatioii of M 
.he image. The image being seanned is .ypically embodied in a physical fo™. such as on J ^ 
photographic media, i.e., film, al.hongh other media may be used. The electromagnetie ^ " 

s "'''^'«""'==<"o conver, the imago into a digitized represemation is infrared light- however 
vtstble hght. microwave and other suitable typos of electromagnetic radiation may also be . 
used to produce the digitized image. 

One embodiment of a duplex scanning apparatus 100, as illustrated in Fig I is used 
to illustrate the present invention and its operation. It will be undei^tood that other'suitable 
.0 embod.ments of scanning apparatus 100 may be employed without departing from the scope 
of the present invention. For example, another embodiment, the scanning apparatus 100 
operates to scan the film through the developer using visible light to detect color dyes in the 
film. In another embodiment, the scamping apparatus 1 00 utilizes a combination of visible 
light detection of the color dyes and duplex imaging, as descnbed in detail below, to measure 
IS Ui« metallic silver panicles in the film. 

Tlte scanning apparatus 100 generally includes a number of optic sensors 102 In (he 
embodiment Illustrated, the optic sensors 102 measure the intensity of electromagnetic energy 
passing through and/or reflected by the film 112. The source of electromagnetic energy is 
.yptcally a light source 110 which illuminates the film 1 12 containing the scene image 104 
» and Ute reference patch image 108 to be scanned. Radiation from the source 110 may be 
dtCfused or directed by addiUonal optics such as filters (not shown, and one or more lenses 
106 postttoned near the sensors 102 and the film 114 in onler to illuminate the images 104 
and 108 mo„= unifonnly. Funhermore. more than one source may be used. Source 110 is 
postnoned on the side of the film 1 12 opposite the optic sensor, ,02. This placement results 
« .n sensors 102 detecting radiation emitted ftom source 1 ,0 as it passes thn,ugh the images 
104 and 108 on the film 1 12. Another radiation source 1 1 1 is shown placed on the same side 
of the film 1 12 as the sensots 102. When source 1 1 1 is activated, sensors 102 detect radiation 
reflected by the images 104 and 108. This process of using two sources positioned on 
opposite sides of the fihn being scamted is described in more detail below in conjunction with 
30 Fig. 2. 
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The optic sensors 102 are generally geometrically positioned in arrays suchfthat the 
electromagnetic energy striking each optical sensor 102 corresponds to a distinct iocatibn 1 1\4 ; 
in the images 104 and 108. Accordingly, each distinct location 114 in the scene image 104 
corresponds to a distinct location, referred to as a picture element, or "pixeP* for short, in the 

5 scanned, or digitized image 105. The images 104 and 108 on film 112 are usually 
sequentially moved, or scanned, across the optical sensor array 102. The optical sensors 102 
are typically housed in a circuit package 1 16 which is electrically connected, such as by cable 
118, to supporting electronics for computer data storage and processing, shown together as 
computer 120. Computer 120 can then process the digitized image 105. Alternatively, 

10 computer 120 can be replaced with a microprocessor and cable 118 replaced with an electrical 
circuit connection. 

Optical sensors 102 may be manufactured from different materials and by different 
processes to detect electromagnetic radiation in varying parts and bandwidths of the 
electromagnetic spectrum. The optical sensor 102 comprises a photodetector (not expressly 
15 shown) that produces an electrical signal proportional to the intensity of electromagnetic 
energy striking the photodetector. Accordingly, the photodetector measures the intensity of 
electromagnetic radiation attenuated by the images 104 and 108 on film 1 12. 

Turning now to Fig. 2, a conventional color film 220 is depicted. As previously 
described, one embodiment of the present invention uses duplex film scanning which refers to 

20 using a front source 216 and a back source 218 to scan a film 220 with reflected radiation 222 
firom the front 226 and reflected radiation 224 from the back 228 of the film 220 and by 
transmitted radiation 230 and 240 that passes through all layers of the film 220. While the 
sources 216, 218 may emit polychromatic light, i.e., multi-frequency light, the sources 216, 
218 are gcnej-ally monochromatic and preferably infrared. The respective scans, referred to 

25 herein as front, back, front-through and back-through, are further described below. 

In Fig. 2, separate color levels are viewable within the film 220 during development 
of the red layer 242, green layer 244 and blue layer 246. Over a clear film base 232 are three 
layers 242, 244, 246 sensitive separately to red, green and blue light, respectively. These 
layers are not physically the colors; rather, they are sensitive to these colors. In conventional 
30 color film development, the blue sensitive layer 246 would eventually develop a yellow dye, 
the green sensitive layer 244 a magenta dye, and the red sensitive layer 242 a cyan dye. 
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During development, layers 242, 244, and 246 are opalescent. Dark silver grains 234 
developing in the top layer 246, the blue source layer, arc visible from ,the^front- 226 of the 
film, and slightly visible firom the back 228 because of the bulk of the opalescent emulsion. 
Similarly, grains 23G in the bottom layer 242, the red sensitive layer, are visible from the 

5 back 228 by reflected radiation 224, but are much less visible from the front 226, Grains 238 
in the middle layer 244, the green sensitive layer, arc only slightly visible to reflected 
radiation 222, 224 from the front 226 or the back 228. However, they are visible along with 
those in the other layers by transmitted radiation 230 and 240. By sensing radiation reflected 
from the front 226 and the back 228 as well as radiation transmitted through the film 220 

10 from both the front 226 and back 228 of the film, each pixel for the film 220 yields four 
measured values, one from each scan, that may be mathematically processed in a variety of 
ways to produce the initial three colors, red, green and blue, closest to the original scene. 

The front signal records the radiation 222 reflected from the illumination source 216 
in front of the film 220. The set of front signals for an image is called the front channel. The 
15 front channel principally, but not entirely, records the attenuation in the radiation from the 
source 216 due to the silver metal particles 234 in the top-most layer 246, which is the blue 
recording layer. There is also some attenuation of the front channel due to silver metal 
particles 236, 238 in the red and green layers 242, 244. 

The back signal records the radiation 224 reflected from the illumination source 218 
20 in back of the film 220. The set of back signals for an image is called the back channel. The 
back channel principally, but not entirely, records the attenuation in the radiation from the 
source 218 due to the silver metal particles 236 in the bottom-most layer 242, which is the red 
recording layer. Additionally, there is some attenuation of the back channel due to silver 
metal partiples 234, 238 in the blue and green layers 246, 244. 

25 - - The front-through signal records the radiation 230 that is transmitted through the film 

220 from the illumination source 218 in back of the film 220. The set of front-through 
signals for an image is called the front-through channel. Likewise, the back-through signal 
records ihc radiation 240 that is transmitted through the film 220 from the source 216 in front 
of the fibn 220. The set of back-through signals for an image is called the back-through 

30 channel. Both through channels record essentially the same image information since they 
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both record iKc aiicnuatibn of the radiation 230, 240 due to the silver metal particles 234, 236, 
238 in all three red, green, and blue recording layers 242, 244, 246 of the film 220. 

Several image processing steps arc required to convert the illuminaiiori source 
radiation information for each channel to the red, green, and blue values similar to those 
5 produced by conventional scanners for each spot on the film 220. These steps are required 
because. the silver metal particles 234, 236, 238 that form during the development process are 
not spectrally unique in each of the film layers 242, 244, 246. These image processing steps 
are not performed when conventional scanners are used because the dyes which are formed 
with conventional chemical color processing of the film make each film layer spectrally 
10 tmique. However, just as with conventional scanners, once initial red, green and blue values 
are derived for each image, further processing of the red, green, and blue values is usually 
done to produce images that more accurately reproduce the original scene and that are 
pleasing to the human eye. 

As described in connection with Fig. 1, the scanning apparatus 100 may include a 
15 calibration exposure device 107 that produces a calibration, or reference patch 350 in an 
unexposed area 352 of the photographic film 320, as illustrated in Fig. 3. This step is 
typically performed by the calibration exposure device 107; however, the reference patch 350 
may be formed before or during scene exposure. After scene exposure and reference patch 
creation, the film 320 is chemically processed, and the attenuation of radiation by the silver 
20 metal particles in the area 352 where the reference patches 350 were created is measured. 
The measured reference patch attenuation is used to calculate image processing parameter 
values that are used to digitally process the front, back and through channels collected for the 
scene image 354 to produce appropriate initial red, green and blue values. 

Thuvone implementation of the present invention involves the following process. 

25 After a roll of film has been exposed to light to form scene'images 354, reference patches 350 
are created on the photographic film 320 in an unexposed area of the film 320. As mentioned 
previously, this step is preferably done at the time of chemical development and film 
scanning. The reference patches 350 may be cither a gray scale or colored, such as red, green, 
or blue. Likewise, the reference patches 350 may consist of both gray scale and colored 

30 patches. The reference patch 350 exposures and spectral properties are accurately known by 
either design or by direct measurement. Then, the front, back, front-through, and back- 
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through signals from each of Ihc reference patches 350 and from each of the scene images. 
354 are measured. As discussed in greater detail below, the image processing parameters^ 
which are used to produce the initial red, green and blue values for the scene images 354 from 
the signals corresponding to those scene images 354 arc derived from the front, back, front- 
5 through, and back-through signals corresponding to the reference patches 350. Finally, the 
front, back, front-through, and back-through channel data for the scene images 354 are 
processed to produce appropriate initial red, green and blue values using the image processing 
parameters that were calculated from the reference patches 350. 

Next, some possible image processing functions which may be used according to the 

10 present invention to produce initial color values from the image processing parameters are 
discussed. One function that uses the reference patch data taught by the present invention is 
known as the Regress-to-Through-Channel ("RTC") function. Basically, for each pixel 
corresponding to each of the four channels, the pixel's color values are adjusted such that 
gray pixels have exactly the same value in each channel. One implementation for performing 

15 Regress-lo-Through-Channel image processing is as follows. First, the front, back, and 
through (either the front-through or the back-through channel may be used) signals from the 
reference gray patches are read. Next, two plots are made, one being the through channel 
mean values for each gray reference patch versus the front channel mean values. The second 
plot is the through channel mean values for each gray reference patch versus the back channel 

20 mean values. Then, an equation is fit to each plot. Any equation type or algorithm could be 
used, although a cubic equation is preferred. For each pixel in the front channel for the entire 
scene image, a new front value is calculated based on the equation that was fit to the through- 
versus-front plot. Likewise, for each pixel in the back channel for the entire scene image, a 
new back value is calculated based on the equation fit to the through-versus-back plot. 

25 Manipulating the pixel data in this way has the effect of producing better grays than prior art 
systems and separating non-gray pixels from gray pixels. 

A second image processing fimction that may make use of the reference patch data is 
a stretch function. In general, values in the front, back, and through (either the front-through 
or the back-through channel may be used) channels are adjusted such that they have the same 
30 range as an aim signal. The aim signal is defined as that set of signals that the calibration 
patches are designed to give. That is, there is an aim signal for each patch that directly 
corresponds to the exposure used to generate that patch. Specifically, the process begins by 
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reading the through channel signals from reference gray patches placed on . the film. Then, a 
plot is made of the aim values of the gray patches versus the through channel means for each* . 
gray reference patch. Next, a best-fit equation is calculated for the plot. While a linear 
equation is preferred, any best-fit equation may be used. The best-fit equation is then applied 
5 to every pixel in the front, back, and through channel data for the entire scene image to give 
new pixel values in each of the channels. Use of the stretch function produces good blacks 
and whites in the scene image reproductions. 

Yet another image processing function involves calculating a color correction 
mapping based on gray and color calibration patches, and applying the color correction 

10 mapping to the entire scene image. First, all pixel values fi-om the calibration patches and the 
entire scene image are converted to a suitable color space. Second, a color correction 
mapping is calculated between the mean values obtained for each calibration patch and the 
corresponding aim values for each patch. The calculation method may assume that the color 
correction mapping is linear or non-linear, and it may be implemented as a regression 

15 technique or by other methods. One example is to calculate a color correction mapping by 
applying a linear regression resulting in a 3 x 3 matrix. Third, the color correction mapping is 
applied to every pixel in the entire scene image. The result is that the scene image is a more 
accurate representation of the color in the original scene than without the color correction 
mapping applied. 

20 It is intended that the description of the present invention provided above is but one 

embodiment for implementing the invention. Variations in the description likely to be 
conceived of by those skilled in the art still fall within the breadth and scope of the disclosure 
of the present invention. For example, although the technique of the present invention has 
been describod in the context of its application to standard color film, another option is to use 

25 a film built specifically for this purpose. The film would require no color couplers as a color 
image never develops. While specific alternatives to steps of the invention have been 
described herein, additional alternatives not specifically disclosed but known in the art are 
intended to fall within the scope of the invention. Thus, it is understood that other 
applications of the present invention will be apparent to those skilled in the art upon the 

30 reading of the described embodiment and a consideration of the appended claims and 
drawings. 
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WE CLAIM: 



1. A method for electronically processing exposed undeveloped film using a . 



reference patch, the method comprising: 



5 



exposing the film to a calibration light source lo create a reference patch; 
coaling a developer solution onto the film; 

electronically scanning the coated film to produce an electronic image and an 



electronic reference image; 

calculating processing parameters using the electronic reference image; and 



2. The method of Claim 1, wherein the step of scanning the coated film 
comprises electronically scanning a dye image in the coated film to produce an electronic 
image and an electronic reference image. 

3. The method of Claim I, wherein the step of scanning the coated film 
15 comprises electronically scanning a latent silver image in the coated film to produce an 

electronic image and an electronic reference image. 

4. The method of Claim I, wherein the step of scanning the. coated film 
comprises electronically scarming a latent silver image and a dye image in the coated film lo 
produce an electronic image and an electronic reference image. 

20 5. The method of Claim 1, wherein the step of calculating processing parameters 

using the electronic reference image comprises defining a color correction map using the 
electronic reference image and a standard. 

6. The method of Claim 1, wherein the reference patch comprises a gray scale 
reference patch. 

25 7. The method of Claim 1, wherein the step of electronically scanning the coated 

film comprises electronically scanning the coaled film using infrared light to produce an 
electronic image and an electronic reference image. 



10 



processing the electronic image using the processing parameters. 
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8. The method ofClaim 1, wherein the step of electronically scanning the coated 
film comprises electronically scanning the coated film using white light to produce an 
electronic image and an electronic reference image. 

9. The method of Claim I, wherein the step of electronically scanning the coated 
5 film comprises electronically scanning the film using front, back, front-through and back- 
through imaging. 

10. The method of Claim 9, wherein the step of calculating processing parameters 
using the electronic reference image comprises: 

plotting mean values for the electronic reference image versus front channel 
10 mean values to fomi a first plot; 

plotting through channel mean values for the electronic reference image versus 
back channel mean values to form a second plot; 

detennining a first equation which best fits the first plot; 
determining a second equation which best fits the second plot; 
15 calculating a new data value for each pixel in the front imaging signal based 

on the first equation; and 

calculating a new data value for each pixel in the back imaging signal based on 
the second equation. 

11. The method of Claim 10 wherein the first and second equations are cubic 
20 equations. 
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12. An electronic film processing system for processing exposed undeveloped 
film, comprising: 

a calibration light source operable to create a reference patch on the film; 

an applicator operable to apply a film processing solution to the film; 

at least one imaging station operable to scan the coaled film and produce an electronic 
image of a scene and the reference patch; and 

a computer processor coupled to the. at least one imaging station, wherein the 
electronic image of the reference patch is used in calculating image processing parameters for 
correcting the electronic image of the scene. 

13. The electronic film processing system of Claim 12, wherein the applicator 
comprises at least one slot coater device. 



14. The electronic film processing system of Claim 12, wherein the at least one 
15 imaging station comprises: 

a light source operable to illuminate the film; and 

a sensor system operable to detect metallic silver particles in the film. 

15. The electronic film processing system of Claim 12, wherein the at least one 
20 imaging station comprises: 

a light source operable to illuminate the film; and 

a sensor system operable to detect color dyes in the film. 

16. The electronic film processing system of Claim 12, wherein the at least one 
25 imaging station comprises: 

~ a first imaging station comprising: 

a first light source operable to illuminate the film; and 

a first sensor system operable to detect metallic silver particles in the film; and 
a second imaging station comprising: 
30 a second light source operable to illuminate the film; and 

a second sensor system operable to detect color dyes in the fiUn. 



12 



wo 01/13174 



17. 



A scene image prepared in accordance with the following steps: 

providing a film with a latent scene image on a first area of the film; 

creating at least one reference patch having known spectral properties on a 



second area of the film; 



5 



applying a developer solution to the film; 



developing the coated film to form a scene image and developed reference 

patch images; 

scanning the coated film to generate signals corresponding to digital 
representations of the developed scene image and the developed patch images; 



developed patch images; and 

processing the digital representations of the developed scene image using the 
calculated image processing parameters to produce color values for the scene image. 

18. The scene image of Claim 17, wherein the developed scene image signals and 
15 the developed patch image signals are generated through front, back, front-through and back- 
through imaging. 

19. The scene image of Claim 17 wherein generating signals corresponding to 
digital representations of the images further comprises: 

directing a first illumination source toward a first surface of said film; 
20 capturing radiation reflected from said first surface on a pixel by pixel basis; 

assigning a data value to the amount of reflected radiation from said first 
surface for each pixel to form the firont imaging signal; 

^ « directing a second illumination source toward a second surface of said film, 
said second surface and said first surface fomiing opposite sides of said film; 
25 capturing radiation reflected from said second surface of said film on a pixel 

by pixel basis; 

assigning a data value to the amount of reflected radiation firom said second 
surface for each pixel to form the back imaging signal; 

capturing radiation transmitted through said film fi"om said second 
30 illumination source on a pixel by pixel basis; 
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calculating image processing parameters from the signals associated with the 
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assigning a data value lo the amount of transmitted radiation from said first 
surface for each pixel to form the front-through imaging signal; 

capturing radiation transmitted through said film from said first illumination 
source on a pixel by pixel basis; and 
5 assigning a data value to the amount of transmitted radiation from said second 

surface for each pixel lo fonn the back-through imaging signal. 

20. The scene image of Claim 19, wherein processing the digital representations 
further comprises: 

reading the front, back, front-through and back-through signals for reference 
10 gray patches; 

plotting through channel mean values for each gray reference patch versus 
front channel mean values to form a first plot; 

plotting through channel mean values for each gray reference patch versus 
back channel mean values to form a second plot; 
15 determining a first equation which best fits the first plot; 

determining a second equation which best fits the second plot; 
calculating a new data value for each pixel in the front imaging signal based 
on the first equation; and 

calculating a new data value for each pixel in the back imaging signal based on 
20 the second equation. 
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